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Abstract: The environment in which the decision-making process takes place is often characterized 
by uncertainty and vagueness and, because of that, sometimes it is very hard to express the criteria 
weights with crisp numbers. Therefore, the application of the Grey System Theory, i.e., grey numbers, 
in this case, is very convenient when it comes to determination of the criteria weights with partially 
known information. Besides, the criteria weights have a significant role in the multiple criteria 
decision-making process. Many ordinary multiple criteria decision-making methods are adapted 
for using grey numbers, and this is the case in this article as well. A new grey extension of the 
certain multiple criteria decision-making methods for the determination of the criteria weights is 
proposed. Therefore, the article aims to propose a new extension of the Step-wise Weight Assessment 
Ratio Analysis (SWARA) and PIvot Pairwise Relative Criteria Importance Assessment (PIPRECIA) 
methods adapted for group decision-making. In the proposed approach, attitudes of decision-makers 
are transformed into grey group attitudes, which allows taking advantage of the benefit that grey 
numbers provide over crisp numbers. The main advantage of the proposed approach in relation to the 
use of crisp numbers is the ability to conduct different analyses, i.e., considering different scenarios, 
such as pessimistic, optimistic, and so on. By varying the value of the whitening coefficient, different 
weights of the criteria can be obtained, and it should be emphasized that this approach gives the same 
weights as in the case of crisp numbers when the whitening coefficient has a value of 0.5. In addition, 
in this approach, the grey number was formed based on the median value of collected responses 
because it better maintains the deviation from the normal distribution of the collected responses. The 
application of the proposed approach was considered through two numerical illustrations, based on 
which appropriate conclusions were drawn. 


Keywords: grey numbers; group decision-making; PIPRECIA; SWARA 


1. Introduction 


Multiple-Criteria Decision-Making (MCDM) aims to provide the decision-maker with 
a choice of the best options from the final set of alternatives by analyzing them from several 
angles, i.e., through several criteria/attributes. Criteria weights can have a significant 
impact on the ranking of alternatives or the selection of the most acceptable alternative 
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in Multiple-Criteria Decision-Making (MCDM). Therefore, many methods have been pro- 
posed so far for determining criteria weights—Entropy method [1], Analytic Hierarchy 
Process (AHP) introduced by Saaty [2], CRiteria Importance Through Intercriteria Cor- 
relation (CRITIC) proposed by Diakoulaki et al. [3], Analytic Network Process (ANP) 
proposed by Saaty and Vargas [4], Step-wise Weight Assessment Ratio Analysis (SWARA) 
proposed by Kersuliene et al. [5], Best-Worst Method (BWM) proposed by Rezaei [6], FUL 
COnsistency Method (FUCOM) proposed by Pamucar et al. [7], etc. 

Besides these methods, there is also a new generation of prominent methods, such 
as the Characteristic Objects Method (COMET) and its extensions [8-12], the preference 
ranking organization method for enrichment evaluation (PROMETHEE)—partial ranking 
and PROMETHEE II—complete ranking [13,14]. The success of these methods is attributed 
to their correct mathematical settings and ease of application in practice. 

Besides determining criteria weights, the SWARA method was used to solve many 
decision-making problems, as well as to determine the weights of criteria in these problems. 
Although it can be observed as a relatively new MCDM method, the SWARA method 
has so far been used for—prioritizing sustainability assessment indicators [15], product 
design from international and local perspectives [16], evaluation of exterior wall insula- 
tion [17], evaluation of packaging design [18], technology foresight about R&D project 
evaluation [19], regional landslide hazard assessment [20], personnel selection [21], copper 
prospecting mapping [22], risk assessment [23], engine operating parameter optimiza- 
tion [24], evaluation of smart card systems in public transportation [25], marine energy 
plant location selection problem [26], evaluation of sustainability indicators for renewable 
energy [27], evaluation of a house plan shape [28], selection of landfill site [29], supplier 
selection [30,31], and so forth. 

Also, many extensions have been proposed for the SWARA method that extends its 
application to use with grey [32,33], fuzzy [34], and rough sets [35]. 

Before applying the SWARA method, it is necessary to rank the criteria according to 
their expected significance, which in some cases may be a limitation for its use. There- 
fore, Stanujkic et al. [36] extended the SWARA method intending to enable determining 
criteria weights even in cases when the criteria are not ranked according to the expected 
significance, and they proposed the name PIvot Pairwise Relative Criteria Importance 
Assessment (PIPRECIA) method for the mentioned extension. 

Unlike the SWARA method, the PIPRECIA method has been used for solving a 
significantly fewer number of decision-making problems. The following articles can be 
mentioned as some examples of the use of this method—determining the significance of 
criteria for the implementation of high-performance computing in Danube region coun- 
tries [37], green supplier selection [38], assessing the quality of e-learning materials [39,40], 
safety evaluation of railway traffic [41], assessment of road transportation risks [42], stack- 
ers selection [43], evaluation of the ICT adoption [44], and so forth. Besides, the PIPRECIA 
method has also been extended for using grey [45] and fuzzy [46] numbers. 

Many extensions of MCDM methods that enable using of grey, fuzzy and neutrosophic 
sets have been done to enable solving complex decision-making problems often associated 
with the inaccuracy and unreliability of the information used to make decisions. However, 
many decision-making problems often require the participation, or examination of the 
attitudes, of more than one decision-maker or respondent. Therefore, in this article, a new 
erey extension of SWARA and PIPRECIA methods adapted for group decision-making is 
proposed. In this extension, the attitudes of the respondents collected using crisp values 
are further transformed into grey interval numbers, thus retaining the possibilities of 
different analyses. 

The main contribution is that the proposed approach allows the attitudes of a larger 
number of respondents, expressed in crisp numbers, to be transformed into gray intervals 
based on the median value of the collected responses. The proposed approach can be used 
as a substitute for approaches in which group decision matrices are formed based on the 
mean value of the answers received from all respondents. Therefore, the main advantage 
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of the proposed approach in relation to the use of crisp numbers is the ability to conduct 
different analyses, i.e., considering different scenarios, such as pessimistic, optimistic, and 
so on. 

Therefore, the remaining part of this article is organized as follows—in Section 2, 
research methodology is presented with some basic elements of grey set theory and the 
calculation procedures of the SWARA and PIPRECIA methods are presented. In Section 3, 
a new approach for transforming respondents’ ratings into appropriate grey interval 
numbers is presented, while Section 4 presents two numerical illustrations in which the 
proposed approach is applied. Finally, conclusions are given. 


2. Research Methodology 
2.1. Grey Numbers 


The Grey Systems Theory is an effective methodology that can be used for solving 
uncertain problems with partially known information [47]. The basic concept of this theory 
is that all information is classified into three categories, depending on their uncertainty, 
and the appropriate colors are assigned to them as follows—known information is labeled 
as white, unknown information is labeled as black, and the uncertainty information is 
labeled grey. The white, black and grey numbers are shown on Figure 1. 


— e white number 
x=x 


X — —00 =+% black number 


a ee 
M M grey number 


Figure 1. White, black and interval grey numbers. 


Definition 1. Grey number [47]. A grey number &x is such a number whose exact value is 
unknown, but the range in which value can lies is known. 


Definition 2. Interval grey number [47]. Interval grey number is a grey number with known 
lower bound x and upper bound x, but with unknown value of x, and it is shown as follows: 


9x E [eI] = [xx <7] (1) 


Definition 3. Basic operations of grey numbers [34]. Let ®x1 = | x1, X1] and x2 = |x>, X2] be 
two grey numbers. The basic operations of grey numbers &x1 and x2 are defined as follows: 


@ x1 + 8x2 = |x] + Xo, X1 + X2], (2) 
x1 — X2 = [x4 — X2, X1 a Xo|, (3) 
x1: 6X2 = [x1 X2, X1:X2], (4) 


= 1 1 
9x1 + Oxy = [x1,%4]- = =|: (5) 
Xo 
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Definition 4. The whitening function [45]. The whitening function transforms an interval grey 
number into a crisp number whose possible values lie between the bounds of the interval grey 
number. For the given interval grey number, the whitened value x,,) of interval grey number ®x is 
defined as 


Xaj = (1-A)x + Ax, (6) 


where A denotes the whitening coefficient, and A € [0,1]. 


In the particular case, when A = 0.5, the whitened value becomes the mean of the 
interval grey number, as follows: 


X(9.5) = 0.5(x +7) (7) 


2.2. The SWARA and the PIPRECIA Methods 


The basic steps of the computational procedures of the SWARA and PIPRECIA meth- 
ods for determining criteria weights based on the attitudes of a respondent, i.e., decision- 
maker or expert, are presented in this section. 


2.2.1. The SWARA Method 


The procedure for determining weights of n criteria by applying the SWARA method 
can be summarized as follows [5,18]: 

Step 1. Identification and selection of criteria; 

Step 2. Sorting criteria according to their expected significance, in descending order; and 

Step 3. Determining the relative significance of criteria. In this step, the relative 
significance of the first criterion is set to 1, while the relative significance of the others s; is 
determined according to the previous one. 

In the SWARA method, s;_; has a value 0 if criterion j — 1 has the same significance 
as the criterion j, s; € [0,1], and the lower value of s;_; indicates a higher significance of 
criterion j in relation to criterion j — 1. 

Step 4. Calculating the value of the coefficient k; as: 


1 Fin] 
k= ibe 8) 
ss+1 ifj>1 
Step 5. Calculating the value of the recalculated significance qj as follows: 
1 ifj=l1 
oe pN 9 
í t ifj>1 a 


Step 6. Calculating the criteria weights w; as follows: 


dj 


wi = =, — (10) 
}j—1 Ik 


The calculation procedure of the SWARA method, for determining the criteria weights, 
is summarized in Figure 2. 
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Criteria identification 
Criteria sorting 


j= 1L; KR=L gal 





Criteria comparation 





False 





Figure 2. Flowchart of the SWARA method. 


2.2.2. The PIPRECIA Method 


The procedure for determining criteria weights by applying the PIPRECIA method 
can be summarized as follows [36]: 

Step 1. Identification and selection of criteria; 

Step 2. Sorting criteria according to their expected significance, in descending order. 

This step is not strictly required in the PIPRECIA method. Unlike the SWARA method, 
the PIPRECIA method can be used even when it is not possible to assess the significance of 
the criteria in advance; and 

Step 3. Determining the relative significance of criteria. In this step, the relative 
significance of the first criterion is set to 1, while the relative significance of the others s; is 
determined concerning the previous one. 

Unlike the SWARA method, in the PIPRECIA method, s;_; = 1 if criterion j — 1 has 
the same significance as the criterion j, s; € (1,2] if criterion j — 1 has higher significance 
than criterion j, and s; € (1,0] if criterion j — 1 has a lower significance than criterion j. 

Step 4. Calculating the value of the coefficient as follows: 


1 Fi] 
n= { if (11) 
2—s; ifj>1 
Step 5. Calculating the value of the recalculated significance as: 
1 ifj=l 
= l g; 12 
ú {4 if j>1 a 


Step 6. Calculating the criteria weights as: 


fj 
Ti (13) 
l j=1 fk 
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The calculation procedure of the PIPRECIA method is shown in Figure 3. 


Criteria identification 


Criteria sorting 











j=1;kķj=1;q;=1; 


Criteria comparation 


Figure 3. Flowchart of the PIPRECIA method. 


From the previously described procedures, it can be concluded that the basic difference 
between SWARA and PIPRECIA methods is in the way of assigning the relative importance 
of the criteria, which is manifested in Equation (11) of the calculation procedure of the 
PIPRECIA method. 

In the case of applying the SWARA method, s; shows how much less important a 
criterion is than the previous one, which is why it is necessary to pre-rank the criteria 
according to their expected significance. In contrast, the PIPRECIA method allows the 
relative significance of the criteria to be less than, equal to, or greater than the significance of 
the previous criterion, which is why in the case of applying this method it is not necessary 
to rank the criteria according to their expected significance. 

The use of the SWARA method has already been proven in numerous published 
papers. In contrast, the PIPRECIA method is proposed as an extension of the SWARA 
method that can be used when it is not possible to determine in advance the expected 
significance of the criteria, as in the case of surveying the attitudes of a large number of 
respondents using electronic questionnaires. 

There are several ways to apply the previously described single-user procedures 
SWARA and PIPRECIA methods in the case of solving group decision-making problems. 
Nevertheless, a new approach for transform individual crisp attitudes into a grey group 
attitude is proposed and discussed below. 
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3. A New Grey Approach for Using SWARA and PIPRECIA Methods in a Group 
Decision-Making Environment 

As mentioned above, decision-makers or experts involved in group decision-making 
assess the values of the relative significance of criteria and express these values using crisp 
numbers. As a result of group evaluation, K lists of relative significances are formed, where 
K denotes the number of decision-makers or experts. 

In such cases, in order to determine the criteria weights, it is possible to: 


e Calculate the group significance as follows: 


1 K k 
Sj = i as Si, (14) 


and then apply the SWARA or PIPRECIA method. 
e Calculate the criteria weights for each respondent w}, and then calculate the group 
criteria weight as follows: 


1 WK 
w =z} (15) 


However, in order to take advantage of the benefits that grey numbers provide, i.e., 
the possibility of analysis, a transformation of respondents’ attitudes into grey relative 
group significance is proposed, using the following steps: 

Step 1. Determine the median value mdn; for each criterion, as follows: 


mdn; = median (si ) (16) 


Step 2. Determine the lower s; and upper 5; bounds of grey relative group significance 
for each criterion, as follows: 


k| ok 
s; = mean(s;|s; < mdnj) (17) 


Sj = mean(s} |s} > mdnj) (18) 


Step 3. Using Equation (6) and different values for the coefficient À, the relative group 
significance can be determined after which the criteria weights can be determined using 
the SWARA or PIPRECIA methods. 

Using the proposed approach, the attitudes of a larger number of respondents, i.e., a 
larger number of crisp ratings, can be transformed into a grey interval, i.e., only two crisp 
numbers, without significant loss of information. 

This means that the proposed approach can provide similar results to approaches in 
which crisp numbers are used, but it also provides an additional possibility to conduct 
analyses. The word similar is used here because in this approach the edges of the interval 
are formed based on the median values of the scores collected from all the respondents. 
Identical weights of the criteria, when the whitened value is 0.5, could be achieved if the 
limits of the grey number were formed on the basis of the mean value instead of the median 
value of the collected relative significances. However, in this approach, forming of the 
grey number based on the median value of collected relative significances was selected 
because it better maintains the deviation from the normal distribution in the collected 
relative significances. 


4. A Numerical Illustrations 


To present the proposed approach in detail, as well as its verification, this section 
presents the results of two studies conducted by a group of 10 master and doctoral stu- 
dents from the Faculty of Applied Management, Economics and Finance (MEF), Belgrade, 
Serbia. Before beginning research about evaluation criteria for assessing the quality of 
websites, students involved in the research are thoroughly introduced using the SWARA 
and PIPRECIA methods. 
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4.1. The First Numerical Illustration 


To verify and explain in more detail the proposed approach, a study with doctoral 
and master students, familiar with the use of SWARA and PIPRECIA methods, was 
conducted. On that occasion, the significance of five criteria for evaluating travel and 
tourism website design ideas, such as On the Grid (https://onthegrid.city/ (accessed 
on 1 March 2021) [49]), Visit Asia (https://www.visitasiatravel.com/ (accessed on 1 
March 2021) [50]), Visit Australia (https: //www.australia.com/en (accessed on 1 March 
2021) [51]), Live Africa (http:/ /www.liveafrica.com/ (accessed on 1 March 2021) [52]), 
Bora Bora (https://www.borabora.com/ (accessed on 1 March 2021) [53]), Visit Serbia 
(https: / /www.serbia.travel/en (accessed on 1 March 2021) [54]) and National Park Djer- 
dap (https:/ /npdjerdap.rs/en/ (accessed on 1 March 2021) [55]), was determined. 

Based on 7 criteria proposed by the 2020 WebAward Competition (http://www. 
webaward.org/ (accessed on 1 March 2021) [56]), that are, Design, Innovation, Content, 
Technology, Interactivity, Copywriting, and Ease of use, the following five criteria are 
defined for evaluating travel and tourism website design ideas: 


Cr,, Availability of information; 
Cr, Structure and navigability; 
Cr3, Design; 

Cr4, Personalization; and 

Crs, Innovations. 


On that occasion, in interactions with the respondents, their meaning was precisely 
determined. During this evaluation, we gave the following meaning to the criteria— 
Criterion Cr; refers to the availability of useful information about the tourist destination 
on the website, while criterion Cr, Structure and navigability, refers to the organization 
of information in such a way that visitors to the website can easily find it. The criterion 
Cr3, Design, refers to the visual appearance of the website and its success to convey the 
beauty of tourist destinations. The Cr, criterion indicates the ability to tailor the website to 
the needs of visitors. This criterion includes the ability to choose the language in which 
the information is displayed, the use of search bars, as well as responsive web design. 
Finally, the criterion Crs, Innovations, refers to the application of current technologies and 
innovations in web design. 

After choosing the criteria, and considering their significances and impact, during a 
tour of the above-mentioned websites, respondents gave their attitudes, which are shown 
in Table 1. It should be noted that the above criteria are listed in order of their expected 
significance, which is necessary for the application of the SWARA method. 


Table 1. Attitudes of respondents as results of the SWARA method. 


Ey E> E3 E4 Es E6 Ev Eg Eo E10 Mean 


Cry 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 
Cro 0.00 0.05 0.06 0.20 0.15 0.01 0.03 0.18 0.15 0.20 0.10 
Crs 0.15 0.10 0.10 0.20 0.20 0.05 0.10 0.20 0.15 0.20 0.15 
Cr4 0.25 0.15 0.10 0.25 0.30 0.10 0.15 0.23 0.17 0.25 0.20 
Crs 0.25 0.20 0.20 0.30 0.40 0.15 0.15 0.25 0.20 0.30 0.24 





Table 1 also shows the mean value of the attitudes of all respondents for each criterion. 
The calculation details and criteria weights obtained based on the mean value, calculated 
by applying the SWARA method, are encountered in Table 2. 
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Table 2. Computational details and criteria weights generated by the SWARA method based on 
mean values. 





Mean kj qj wj’ Rank 
Cry 1.00 1 1 0.257 1 
Cro 0.10 1.10 0.91 0.233 2 
Crs 0.15 1.15 0.79 0.203 3 
Cr4 0.20 1.20 0.66 0.170 4 
Crs 0.24 1.24 0.53 0.137 5 


The individual criteria weights calculated on the attitudes of each respondent are 
shown in Table 3. Table 3 also shows group criteria weights calculated as the average of 
individual criteria weights. 


Table 3. Individual and group criteria weights calculated by the SWARA method. 


yy 


Wel We2 We3 We4 We5 We6 We7 Wes Weg Wel0 Wj 


Cry 0.24 0.24 0.24 0.28 0.28 0.22 0.23 0.28 0.26 0.28 0.256 
Crp 0.24 0.23 0.22 0.24 0.24 0.22 0.23 0.24 0.23 0.24 0.232 
Cr3 0.21 0.21 0.20 0.20 0.20 0.21 0.21 0.20 0.20 0.20 0.203 
Cr4 0.17 0.18 0.18 0.16 0.16 0.19 0.18 0.16 0.17 0.16 0.170 
Crs 0.14 0.15 0.15 0.12 0.11 0.16 0.16 0.13 0.14 0.12 0.138 





From Tables 2 and 3, it can be seen that both approaches give the same criteria 
weights, as well as the same ranking order of criteria based on their significance, that is 
Cy > Cr > C3 > Cra > Cy5, which confirms that the expected significance of the criteria 
was correctly assessed, as well as that all respondents filled in the questionnaires correctly. 

It is important to note here that the evaluation was performed by respondents familiar 
with the methods used and that they entered their views in a questionnaire made in the 
spreadsheet program which immediately calculated criteria weights and displayed values 
numerically and graphically after entering the relative significance of each criterion. In this 
way, the respondents were able to correct their grades if necessary. Respondents were also 
suggested that they could modify their responses until they gained criteria weights that 
reflected their real opinion. 


Determining the Criteria Weights Based on the Proposed Grey Approach 


Determining criteria weights using the proposed approach began by determining 
the median values for each criterion, after which the lower and upper bounds of the grey 
numbers were determined. The median, lower and upper bounds of grey numbers are 
arranged in Table 4. Table 4 also shows the values of relative group significance obtained 
by applying Equation (6) and A = 0.5, as well as its deviations from the mean. 


Table 4. Median, left, and right bounds of grey ratings. 





mdnj . Sj sj” A A% 
Cry 0.24 0.24 0.24 0.28 0.28 0.22 
Cr 0.24 0.23 0.22 0.24 0.24 0.22 
Crs 0.21 0.21 0.20 0.20 0.20 0.21 
Cr4 0.17 0.18 0.18 0.16 0.16 0.19 
Crs 0.14 0.15 0.15 0.12 0.11 0.16 


Due to the complexity of the procedure for determining the left and right bounds of 
the grey interval, the calculation was performed using a program written in the Python 
programming language. 
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The criteria weights determined based on the left and right boundaries of the grey 
interval are shown in Table 5. The criteria weights calculated using Equation (6) and A = 0.5 
are also shown in Table 5. 


Table 5. The criteria weight obtained based on grey ratings. 


Cry 0.279 0.234 0.257 
Cro 0.237 0.227 0.233 
Cr3 0.201 0.205 0.203 
Cr4 0.160 0.181 0.170 
Crs 0.123 0.153 0.137 


Table 6 shows the criteria weights obtained based on the mean value of relative 
significance (w;’), the mean values of the weights obtained based on the respondents’ 
attitudes (w;”), and the weights obtained by applying the proposed approach (w;”’). 

Table 6. The criteria weight obtained using three approaches. 


J Wy Ws 


Wj Wj Wj 
Cr 0.257 0.256 0.257 
Cro 0.233 0.232 0.233 
Cr 0.203 0.203 0.203 
Cr, 0.170 0.170 0.170 
Crs 0.137 0.138 0.137 


It can be noticed from Table 6 that all three considered approaches give almost the 
same criteria weights. 

To verify the applicability of the proposed approach in the case of application of the 
PIPRECIA method, the values in Table 1 were recalculated as follows: 


T M a a9) 
1—s; ifj>1 


This recalculation was necessary due to differences in the calculation of the coefficient 
k;, i.e., in Equations (8) and (11), in the SWARA and PIPRECIA methods. This way of value 
transformation was chosen because the aim of this research was not to compare the results 
obtained using the SWARA and PIPRECIA methods but to check the applicability of the 
proposed procedure. The results achieved using SWARA and PIPRECIA could differ to 
some extent because the relatively important feature is the assessment of the respondent. 
Even in the case of re-evaluation using some of the above methods, certain deviations 
may occur. 

The recalculated values from Table 1 are shown in Table 7. 


Table 7. Attitudes of respondents adapted for applying the PIPRECIA method. 


E1 E> E3 E4 Es E6 Ev Eg Eg E10 Mean 


Cry 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 
Cro 1.00 0.95 0.94 0.80 0.85 0.99 0.97 0.82 0.85 0.80 0.90 
Cr3 0.85 0.90 0.90 0.80 0.80 0.95 0.90 0.80 0.85 0.80 0.86 
Cr4 0.75 0.85 0.90 0.75 0.70 0.90 0.85 0.77 0.83 0.75 0.81 
Crs 0.75 0.80 0.80 0.70 0.60 0.85 0.85 0.75 0.80 0.70 0.76 





The values obtained using the three approaches, and the PIPRECIA method, are given 
in Tables 8-10, while the comparison of weights obtained using the three approaches is 
summarized in Table 11. 
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Table 8. Computational details and the criteria weights obtained by the PIPRECIA method based on 
mean values. 








Mean kj qj wj’ 

Cry 1.00 1 1 0.257 

Cro 0.90 1.10 0.91 0.233 

Crs 0.86 1.15 0.79 0.203 

Cr4 0.81 1.20 0.66 0.170 

Crs 0.76 1.24 0.53 0.137 

Table 9. Individual and group criteria weights calculated using the PIPRECIA method. 

e1 We2 We3 Wed Wed We6 We7 Weg Weg We10 Wj ” 
Cry 0.24 024 0.24 028 0.28 022 0.23 028 0.26 0.28 0.256 
Cro 0.24 023 0.222 024 0.24 O22 0.23 0.24 0.23 £0.24 0.232 
Cr3 0.21 O21 0.20 0.20 0.20 0.21 £0.21 0.20 0.20 0.20 0.203 
Cra 0.17 0.18 O18 0.16 0.16 O19 0.18 O16 0.17 0.16 0.170 
Crs 0.14 O15 O15 O12 0.11 O16 016 O13 014 0.12 0.138 


Table 10. The criteria weight obtained based on grey ratings. 


Cry 
Cr 
Cr3 
Cr4 
Crs 


mdn, 


1.000 
0.895 
0.850 
0.800 
0.775 


1.000 
0.824 
0.817 
0.744 
0.700 


1.000 
0.970 
0.892 
0.866 
0.820 


Table 11. The criteria weight obtained using three approaches. 


J 
w) 


0.257 
0.233 
0.203 
0.170 
0.137 


II 
wj 


0.256 
0.232 
0.203 
0.170 
0.138 


0.257 
0.233 
0.203 
0.170 
0.137 


As in the case of using the SWARA method, it can be seen from Table 11 that all three 
approaches give almost the same criteria weights. 
Finally, Table 12 shows a comparison of criteria weights obtained using the SWARA 
and PIPRECIA methods, the proposed grey approach, and A = 0.5. 


Table 12. The comparison of criteria weight obtained using the SWARA and PIPRECIA methods. 


Cry 
Cr 
Crs 
Cr, 
Crs 


SWARA 


III 
Wj 


0.257 
0.233 
0.203 
0.170 
0.137 


PIPRECIA 


III 
w; 


0.257 
0.233 
0.203 
0.170 
0.137 


As can be seen from Table 12, both approaches give the same criteria weights. 
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4.2. The Second Numerical Illustration 


In the second part of the research, the aforementioned group of students determined 
the significance of the criteria for evaluating e-commerce websites, from the viewpoint of 
first-time visitors, using the PIPRECIA method. On this occasion, the significance of the 
following criteria, adopted from Stanujkic and Magdalinovic [57], was determined: 


Crı, Design of the website; 

Cr, Easy to use; 

Cr3, Quality and availability of information; 
Cr4, Ordering process; and 

Crs, Security assurance. 


In this evaluation, the following meanings were assigned to the above-mentioned 
criteria. Criterion Cr, refers to the website’s design, while criterion Crz, Easy to use, refers 
to the possibility of easily finding the desired product and the possibility of sorting and 
selecting products. Criterion Cr3 refers to the information about products and organization 
of information to enable easier decision-making about ordering products. Criterion Cr4 
refers to the complexity, intuitiveness, and flexibility of the ordering process, while criterion 
Crs, Security assurance, refers to the assessment of ordering security from the website in 
the sense that they will actually receive products of appropriate quality, and the possibility 
of complaints and the security of their personal information and payment card numbers. 

After discussing the meaning of the above criteria, a list that contained five e-commerce 
websites, that none of the respondents had visited before, was formed. This list of web- 
sites was compiled by the following websites—www.eponuda.com (accessed on 21 March 
2021) [58], www.gamecentar.rs (accessed on 21 March 2021) [59], www.mi-srbija.rs (ac- 
cessed on 21 March 2021) [60], www.3egstore.rs (accessed on 21 March 2021) [61], and 
www.lalafo.rs (accessed on 21 March 2021) [62]. 

The attitudes of the respondents collected during the evaluation are shown in Table 13, 
as well as their mean. 


Table 13. Respondents’ attitudes obtained based on the use of the PIPRECIA method. 


Ey E> E3 E4 Es E6 E7 Eg Eg E10 Mean 


Cry 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 
Cro 1.20 1.10 1.00 1.00 1.05 0.80 0.90 1.20 1.10 1.15 1.05 
Cr3 1.20 1.00 1.00 1.20 1.10 1.20 1.20 1.20 1.20 1.30 1.16 
Cr4 1.00 1.10 0.90 1.00 1.00 0.90 1.10 1.10 1.00 1.00 1.01 
Crs 1.10 1.10 1.10 1.00 1.00 1.05 0.90 1.00 1.00 1.00 1.03 


The calculation details and the criteria weights obtained based on the mean value are 
encountered in Table 14, while the group criteria weights, calculated based on the average 
of individual criteria weights, are shown in Table 15. 


Table 14. The computational details and the criteria weights obtained using the PIPRECIA method 
based on mean values. 


Mean k; qj wj’ 
Cry 1.00 1 1 0.170 
Cr 1.05 0.95 1.05 0.179 
Crs 1.16 0.84 1.25 0.213 
Cr4 1.01 0.99 1.27 0.216 


Crs 1.03 0.98 1.30 0.221 
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Table 15. Individual and group criteria weights calculated by applying the PIPRECIA method. 


yy 


Wel We2 We3 We4 We5 We6 We7 Wes Weg Wel0 Wj 


Cry 0.14 0.17 0.20 0.17 0.18 0.21 0.18 0.14 0.16 0.14 0.170 
Crp 0.18 0.19 0.20 0.17 0.19 0.17 0.17 0.17 0.18 0.16 0.179 
Cr3 0.22 0.19 0.20 0.22 0.21 0.22 0.21 0.21 0.22 0.23 0.213 
Cr4 0.22 0.21 0.18 0.22 0.21 0.20 0.23 0.24 0.22 0.23 0.216 
Crs 0.24 0.24 0.21 0.22 0.21 0.21 0.21 0.24 0.22 0.23 0.221 





The criteria weights obtained using the proposed approach are shown in Table 16. 
Finally, the comparisons of weights obtained using three approaches are presented in 
Table 17. 


Table 16. The criteria weight obtained based on grey ratings. 


mdni if Sj wj my 
Cry 1.000 1.000 1.000 1.000 0.169 
Cro 0.895 0.824 0.970 0.897 0.178 
Cr3 0.850 0.817 0.892 0.854 0.216 
Cr4 0.800 0.744 0.866 0.805 0.217 
Crs 0.775 0.700 0.820 0.760 0.220 


Table 17. The criteria weight obtained using three approaches. 


y ” 11 
W 


j Wj Wj 
Cry 0.170 0.170 0.169 
Cry 0.179 0.179 0.178 
Crs 0.213 0.213 0.216 
Cra 0.216 0.216 0.217 
Crs 0.221 0.221 0.220 


As can be observed from Table 17, all considered approaches gave almost the same 
criteria weights. 


5. Conclusions 


An innovative approach for determining criteria weights in case of group decision- 
making, using SWARA or PIPRECIA methods, is proposed in this article. 

In this approach, it is proposed to transform the respondents’ attitudes into appro- 
priate grey intervals, instead of transforming them into crisp values. Using grey, instead 
of crisp, numbers provides much greater possibilities, primarily for performing certain 
analyses. Therefore, in this article, two numerical examples were conducted and the 
justification of the proposed approach is confirmed. Also, by varying the value of the 
whitening coefficient, different weights of the criteria can be obtained, and it should be 
emphasized that this approach gives the same weights as in the case of crisp numbers 
when the whitening coefficient has a value of 0.5. 

The study was conducted with a group of 10 selected respondents from a group of 
25 respondents who were instructed to apply the SWARA and PIPRECIA methods. 

The results obtained by applying the proposed approach, in the considered cases, are 
identical to the results obtained by the used procedures based on the application of crisp 
numbers. Besides, the results obtained using the SWARA and PIPRECIA methods are 
the same in all cases considered, which confirms that this approach can be used with the 
SWARA and PIPRECIA methods. 

The advantage of this approach is reflected in the possibility of combining crisp and 
grey numbers, where crisp numbers are used for collecting the respondents’ attitudes, 
while grey numbers are used for expressing attitudes of all respondents that are group 
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attitudes. In this way, the possibility of a simple collection of respondents’ attitudes and 
the advantages of grey numbers is combined, primarily in terms of conducting analyses. 

In addition, in this approach, the grey number was formed based on the median 
value of collected responses because it better maintains the deviation from the normal 
distribution of the collected responses. 

The proposed approach can be used for determining the criteria weights as well as 
for completely solving the MCDM problem. Finally, as a direction for future research, 
the proposed approach can be easily adapted for applying triangular fuzzy numbers, or 
even interval-valued triangular fuzzy numbers, i.e., new extensions for solving a wider 
spectrum of complex real-world problems could be proposed. 
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